…acpp engine

chore: cleanup httplib

* feat: model estimation

* fix: cleanup and improve

* chore: cleanup

* chore: API docs

* chore: CLI docs

* fix: correct calculation

* fix: handle macOS

* chore: typo

---------

Co-authored-by: vansangpfiev <sang@jan.ai>

fix: floating point for models endpoint

Co-authored-by: vansangpfiev <sang@jan.ai>

…cumentation

Chore/update structured output documentation

* chore: config_yaml_utils

* chore: file_manager_utils

* chore: curl_utils

* chore: system_info_utils

* chore: clean e2e tests

* fix: build macos

* fix: docker e2e tests

* fix: e2e docker

* fix: e2e tests

---------

Co-authored-by: vansangpfiev <sang@jan.ai>

feat: add messages api

docs: fix tools should be array not object

* fix: support ctx_len for model start cli

* chore: docs

* fix: guard max ctx_len

* Init remote engine

* Fix: CI build windows

* Fix: CI build windows

* Fix: CI build windows

* Fix: CI build windows

* feat: new db schema for model and template for engine

* Add remote model

* Add Get, List, Update support for remote models

* change model_id to model in remote engine

* fix: mac compatibility

* chore: some refactors before making big changes

* feat: db ops for engines

* chore: small refactor before more changes

* Update engine

* refine db schema, composite key for engines

* add entry definition for engine at db layer

* complete add, get engine operations

* engine managements

* Integrate with remote engine to run remote model

* error handling and response transform

* Support for stream request

* chore: fix conflicts

* feat: anthropic

* feat: support anthropic

* feat: support anthropic

* chore: rename

* chore: cleanup and fix unit tests

* fix: issue with db

* chore: refactor remote engine

* fix: e2e tests

* fix: e2e tests

* chore: API docs

* fix: use different interface for remote engine

---------

Co-authored-by: Luke Nguyen <luke.nguyen990@gmail.com>
Co-authored-by: vansangpfiev <sang@jan.ai>
Co-authored-by: vansangpfiev <vansangpfiev@gmail.com>

feat: add thread

* fix: deadlock when unload engine

* fix: add lock

* feat: add assistants

* add pagination messages

* allow edit content of message

Co-authored-by: Hien To <tominhhien97@gmail.com>

* fix: create assistant

* fix ci

* feat: prioritize GPUs

* fix: migrate db

* fix: add priority

* fix: db

* fix: more

* fix: migration

---------

Co-authored-by: vansangpfiev <sang@jan.ai>

* chore: add document

* feat: update engine interface

* fix: stop inflight chat completion

* chore: bypass docker e2e test

* fix: comments

---------

Co-authored-by: vansangpfiev <sang@jan.ai>

Co-authored-by: Hien To <tominhhien97@gmail.com>

* feat: add files api

* add backward support

* add db support

* fix link issue on windows

* feat: prioritize GPUs

* fix: migrate db

* fix: add priority

* fix: db

* fix: more

* feat: model sources

* feat: support delete API

* feat: cli: support models sources add

* feat: cli: model source delete

* feat: cli: add model source list

* feat: sync cortex.db

* chore: cleanup

* feat: add metadata for model

* fix: migration

* chore: unit tests: cleanup

* fix: add metadata

* fix: pull model

* chore: unit tests: update

* chore: add e2e tests for models sources

* chore: add API docs

* chore: rename

---------

Co-authored-by: vansangpfiev <sang@jan.ai>

Signed-off-by: James <namnh0122@gmail.com>

* fix: load engine linux

* fix linux

---------

Co-authored-by: vansangpfiev <sang@jan.ai>

Co-authored-by: vansangpfiev <sang@jan.ai>

* fix: improve streaming message for remote engine

* feat: improve remote engine

* chore: cleanup

* fix: correct remote engine check

* chore: add unit tests

* fix: cleanup

* chore: cleanup

---------

Co-authored-by: vansangpfiev <sang@jan.ai>

* fix: check cpu info size

* fix: sort gpus

* fix: only use dll search path if ENGINE_PATH is not set

* chore: remove unused

* fix: check cpu info size

* fix: sort gpus

* chore: add log for cpu instructions

* fix: add guard